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ALIGNMENT STRUCTURE AND METHOD FOR MULTIPLE FIELD CAMERA 

CROSS-REFERENCE TO RELATED APPLICATIONS 
[0001] Not Applicable 

STATEMENT RE: FEDERALLY SPONSORED RESEARCH/DEVELOPMENT 
[0002] Not Applicable 

BACKGROUND OF THE INVENTION 

[0003] The present invention relates in general to alignment structure and method for a 
multiple-field camera, and more particular, to alignment structure and method to align the 
multiple-field camera using a single spot light source. 

[0004] Image registration is a fundamental task required in many applications of image 
processing which involves taking two or more images and aligning them so as to either eliminate 
differences between them or highlight the salient differences for the purpose of study. The 
former situation occurs within such areas as target matching and the latter when producing depth 
information from stereo pairs or mapping changes over time. Currently, there are essentially 
four different types of registration, including multi-modal registration, template registration, 
viewpoint registration and temporal registration. In multi-modal registration, images have been 
taken by different types of sensors. In template registration, a referenced image is to be found 
inside a larger image. This is useful for locating a specific feature on a map. The viewpoint 
registration images the same object with two similar sensors at the same moment from different 
positions, while temporal registration photographs the same object from the same viewpoint at 
different times. Single element multiple field cameras have been designed to capture well 
aligned temporally registered images. To obtain sub-pixel accuracy of any of the above 
registrations between optical fields, well-registered and stable camera configurations are 
required. 



[0005] An integrated lens has been used in the single element multiple field cameras. In this 
design, the lens position is constantly referenced to the same mechanical plane referred as a focal 
plane. This minimizes allowable movements critical to maintaining alignment. However, since 
the manufacture of the focal plane leaves position errors of greater than 1/10 pixel of the camera 
to external physical features (typically 2 microns), a mechanical alignment to physical attributes 
is not possible unless pixels are visible. 

[0006] In U.S. Patent No. 5,479,015, a multi-image detector assembly has been disclosed. 
The multi-image detector assembly allows image detection occurring continuously and 
simultaneously so as to provide a spatially and temporally correlated set of separate images 
utilizing a single focal plane. However, alignment or correction of position of the focal plane 
relative to the lens is not addressed. 



BRIEF SUMMARY OF THE INVENTION 
[0007] The present invention provides an alignment structure and an alignment method 
which generate a plurality of spot images from the same light source and aligns individual spot 
images between different fields independently without affecting the alignment of other spot 
images. The camera includes a plurality of focusing members referenced to a common focal 
plane array of a plurality of detectors. The alignment structure comprises a light source, a 
collimator and a multiple-beam generator. The light source is operative to generate a light beam 
suitable for spectral characteristics of the camera, and the collimator collimates the light beam 
into a collimated light spot with a predetermined dimension. The multiple-beam generator then 
splits the light beam into a plurality of components converging on the camera at angles within 
field of view of the camera. In one embodiment, the predetermined dimension is larger than one 
pixel and smaller than three pixels of the camera to result in a spot image with energy significant 
in the region of 5><5 pixels of the focal plane. 

[0008] The multiple-beam generator further comprises a platform, a central aperture, a 
plurality of peripheral apertures, a plurality of first mirrors and a plurality of second mirrors. 
The central aperture perforates through a center of the platform by a dimension smaller than the 
predetermined dimension of the collimated light spot. Therefore, by aligning the centroid of the 
collimated light spot with the central aperture, only a central portion of the collimated light beam 
propagates through the platform as a central component. The peripheral apertures are formed by 
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perforating the platform about the central aperture. The first mirrors are arranged on the 
platform to split the edge portion of the collimated light spot into a plurality of peripheral 
components and reflect the peripheral components onto the second mirrors, while the second 
mirrors are positioned and oriented to reflect the peripheral components to propagate through the 
apertures and converge at the focusing members. The first and second mirrors are further 
adjusted to converge the peripheral components at the camera at angles approaching field of 
view of the camera. 

[0009] The alignment structure further comprises a kinematic stage for disposing the 
focusing members of the camera thereon. The kinetic stage is preferably operative to translate 
and rotate the focusing members with 6 degrees of freedom. Therefore, the orientations and 
positions of focusing members of the camera can be adjusted to optimize the spot images 
captured on the focal plane from the central and peripheral components. 
[0010] The present invention further provides a single-element multiple-field camera system 
comprising a camera and an alignment structure. The camera comprises a plurality of focusing 
members and a common focal plane array of a plurality of detectors for the focusing members. 
The alignment structure comprises a light source operative to generate a light beam suitable for 
spectral characteristics of the camera, a collimator disposed along an optical path of the light 
beam generated by the light source, a multiple-beam generator disposed along an optical path of 
the light beam propagating through the collimator, and a kinematic stage for translating and 
rotating the focusing members relative to the focal plane array. 

[0011] The focusing members are integrated into a single slab of material, and the material 
includes silicon. The collimator is operative to collimate the light beam generated by the light 
source into a collimated spot light with a dimension larger than one detector and smaller than 
three detectors of the focal plane array. The multiple-beam generator comprises a platform, a 
central aperture, a plurality of first mirrors, a plurality of second mirrors, and a plurality of 
peripheral apertures. The platform is disposed perpendicular to propagation of the collimated 
spot light. The central aperture is perforated through the platform and aligned with centroid of 
the collimated spot light. The first mirrors are mounted on the platform and are positioned and 
oriented to split an edge portion of the collimated spot light into a plurality of peripheral 
components. The peripheral apertures are perforated through the platform around the central 
aperture The second mirrors are mounted on the platform and positioned and oriented to reflect 
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the peripheral components to propagate through the peripheral apertures and converge at the 



camera 



[0012] By the above alignment structure, a central spot image and a plurality of peripheral 
spot images around the central spot image are formed on the focal plane array for each focusing 
member. The camera can thus be aligned by translating and rotating the focusing members along 
various directions to overlap the central and peripheral spot images formed for different focusing 
members. 

[0013] In one embodiment, the multiple-beam generator includes four first mirrors, four 
second mirrors and four peripheral apertures arranged to split the edge portion of the light source 
into four peripheral components; and consequently, four peripheral spot images are formed by 
each focusing member. 

[00141 The present invention further provides an alignment method for a camera with a 
multiple-elemen. lens and a focal plane array of pixels. The method comprises the following 
steps A light beam snitable for spectral characteristics of the camera is generated. The hght 
beam is collimated into a light spot with a predetermined dimension. The light spot is split into 
one central component and a plurality of peripheral components about the centra, component, 
such that one central spot image and a plurality of peripheral spot images are formed on the focal 
plane array for each field of the camera. The multiple-element lens is then translated and rotated 
along various directions to optimize spot images of the central and peripheral components 
captured on the focal plane array. 

,0015) In the above method, the light beam is preferably collimated into the light spot wrth a 
dimension larger man one pixel and smaller than three pixels of the camera. The light spot ,s 
preferably split into the central and peripheral components converging at the multiple-element 
lens with angles within field of view of fire camera. The step of translating and rotating the 
multiple-elemen, fens comprises the following steps (a) to (g). In step (a), the multiple-elemen, 
,e»s is handed along a firs, direction for coarsely focusing tire centia, and peripheral spo, 
images. .„ s,ep (b), ,he multiple-elemen, lens is ro,a,ed about dre firs, direction for mimmtzmg 
distance of the ccntia, spo. images between the fields. In step (c), dte multiple-elemen, fens ,s 
ro ,a,ed along a second direction and a third direction perpendicular .o tire firs, direction for 
offsening difference of origins be«ween the fields. In step (d), tire multiple-elemen, lens ts 
rotated abon, tire firs, direction for refining alignment of central spot images between ft. fields. 



In step (e), the multiple-element lens is rotated about the second direction to minimize distance 
of the peripheral spot images arranged along the second direction between the fields. In step (f), 
the multiple-element lens is rotated about the third direction to minimize distance of the 
peripheral spot images arranged along the third direction between the fields. In step (g), the 
multiple-element lens is translated along the first direction for further focusing the central and 
peripheral spot images. 

[0016] The alignment method as discussed above further comprising repeating steps (d) to (f) 
until the distances of the central components and the peripheral components between the fields 
are within a predetermined tolerance, and repeating step (g) until the spot images are focused 
within a predetermined tolerance. In one embodiment, the predetermined tolerance of the 
distance is 1/10 pixel of the focal plane. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0017] These, as well as other features of the present invention, will become apparent upon 
reference to the drawings wherein: 

[0018] Figure 1 is a schematic drawing of a camera system that includes a multiple-element 
lens on a single element; 

[0019] Figure 2 shows the kinematic stage used for adjusting positions and orientations of 
the multiple-element lens relative to a focal plane array of the camera system; 
[0020] Figure 3 shows a schematic drawing of an alignment structure for aligning the 
multiple-element lens; 

(00211 Figure 4 shows a perspective view of the multiple-beam generator of the ahgnmen. 
structure as shown in Figure 3; 

[00221 Figure 5 shows an image eaptured by a camera system with duai field of v,ews as 
shown in Figure 2; 

[0023] Figure 6 shows the optieal path of an autoeollimato, that uses retro-reflecUon to ahgn 

the multiple-beam generator; and , . 

[00241 Figure 7 shows a flow chart of the alignment algorithm provided by the present 

invention. 
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DETAILED DESCRIPTION OF THE INVENTION 
[0025] The present invention provides alignment structure and algorithm of a single element 
multiple field camera. A camera system that employs a multiple-element lens or several 
individual lenses mounted to a single element referenced to a single focal plane can be aligned 
with high precision with the alignment structure provided by the present invention. Figure 1 
shows an exemplary camera system that employs a multiple-element lens which integrates two 
focusing members or lens members into a single slab of material such as silicon (Si). As shown 
in Figure 1, the camera comprises a multiple-element lens 10 and a focal plane 12. In this 
embodiment, two focusing members 10A and 10B are integrated as the multiple-element lens 10, 
such that when an imaging light beam is incident on the multiple-element lens 10 within the 
range of the input apertures (the circles as shown in Figure 1), two images are focused and 
captured by detectors (pixels) formed on two sections 12A and 12B of the focal plane 12. It will 
be appreciated that in addition to the focusing functions, according to specific requirement, the 
multiple-element lens 10 may further provide other optical effects such as diffraction and 
refraction of the incoming light. In addition, more than two focusing members can be applied to 
the camera system for generating multiple fields of images on the focal plane 12. 
[0026] The multiple-element lens 10 is placed on a stage 20, such that the position and 
orientation of the multiple-element lens 10 relative to the focal plane 12 are adjustable. In this 
embodiment, the stage 20 includes a kinematic stage with six degrees of freedom (DOF). That 
is the multiple-element lens 10 placed on the stage 20 can be translated along three translate 
axes x y z and rotated along three rotation axis 0x, 9y, and 9z as shown in Figure 2. Preferably, 
the stage 20 must have minimum resolvable movements of about 10 orders of magnitude smaller 
than the maximum error allowed by the camera system. It is appreciated that stage with fewer 
degrees of freedom can be used if the optic is aligned correctly allowing large amounts of error 
in some movement. 

,0027) As mentioned above, to obtain a well registered image, the multiple-element lens 10 
has to be well aligned to precisely foeus the incoming imaging light on the focal plane array 12. 
Figure 3 shows a perspective view of an alignment structure provided by the present inventton. 
As shown, the alignment structure, including a Ugh. source 30, a collimator 32, and a multiple 
beam generator (MBG) 34, is employed for aligning the multiple-element lens 10 of the camera 
system The light source 30 is used to generate a light beam suitable for the spectral 



-6- 



characteristics of the camera system. In this embodiment, a spot light source is preferred, and 
the collimator 32 has sufficient length and girth for collimating the light beam into a spot slightly 
larger than a single pixel but smaller than 3 pixels of the camera system. With the diffraction of 
the optics of the camera system, the energy of the spot can be significant on a region with 5x5 
pixels of the focal plane 12. The spot light source Ls generated by the light source 30 and 
collimated by the collimator 32 is then aligned with a center of the multiple-beam generator 34. 
[0028] Figure 4 shows a perspective view of the multiple-beam generator 34. The multiple- 
beam generator 34 includes a platform 40 which is opaque to the spot light source Ls and 
disposed substantially perpendicular to the spot light source Ls. A plurality of propagating 
channels is formed through the multiple-beam generator 34 by perforating the platform 40 wrth 
one central aperture 41 at a center thereof and a plurality of peripheral apertures 45 about the 
central aperture 41. The diameter of the central aperture 41 is smaller than the diameter of the 
spot light source Ls, such that by aligning the centroid of the spot light source Ls with the 
aperture 41, only a central portion of the spot light source Ls propagates through the aperture 41, 
while the edge portion of the spot light source Ls fall on the platform 40 around the central 
aperture 41. This central portion of the spot light source Ls is referred as the central component 
Lcs of the spot light source Ls. As shown in Figure 4, a plurality of mirrors 43 are mounted on 
the platform 40 around the central aperture 41, such that the edge portion of the spot light source 
Ls is incident on the mirrors 43 and reflected thereby. In this manner, the edge portion of the 
spot light source Ls is split into a plurality of edge component Les. Preferably, the mirrors 43 
are located between the central aperture 41 and the peripheral apertures 45, and the multiple- 
beam generator 34 further comprises a plurality of mirrors 44 located at the sides of the 
peripheral apertures 45 opposing to the mirrors 43 . The mirrors 44 are adjusted to allow the edge 
components Les split by each of the mirrors 43 incident thereon and reflected thereby, so as to 
propagate through the corresponding peripheral apertures 45. The mirrors 43 and 44 are 
adjustable to collimate and direct the edge components Les at a specific angle with respect to the 
central component Lcs. As a result, the central component Lcs and the edge components Les 
converge at the multiple-element lens 10 of the camera system with an angle within the field of 
view (FOV) of the camera system. 

,00291 In the embodiment as shown in Figures 3 and 4, four peripheral apertures 45 are 
toed about me eemral aperture 41. Aecordingly, .he alignment sttneture ineludes four mtrtors 



43 mounted on the platform 40 between the central aperture 41 and the peripheral apertures 45 to 
generate four edge components Les and four mirrors 44 at the periphery of the platform 40 to 
reflect these four edge components Les. For a camera system including two focusing members 
10A and 10B as shown in Figure 2, two fields of images are obtained as shown in Figure 5. In 
this embodiment, as the spot light source Ls is split into five components, including one central 
component Les and four edge components Les, five spot images, including one central spot 
image Ic and four peripheral spot images Ip, are captured by the focal plane array 12 for each 
field. As shown in Figures 3, 4 and Figure 5, for each focusing members 10A and 10B, two of 
the peripheral spot images Ip are aligned with the central spot image Ic along a vertical direction 
(x-direction), while the other two of the peripheral spot images Ip are aligned with the central 
spot image Ic along a horizontal direction (y-direction). Therefore, one can align the multiple- 
lens element 10 by optimizing the central spot image Ic and the peripheral spot images Ip in 
separate steps. Instead of rotating the multiple-element lens 10 along various directions for each 
individual peripheral spot image Is, these peripheral spot images Ip can be optimized by rotating 
the multiple-element lens 10 about only the vertical direction and the horizontal direction. 
Further, though the peripheral spot image Ip and the central spot image Ic are obtained from the 
same light source Ls, the adjustment or optimization of the peripheral spot image Ip does not 
affect the adjustment or optimization of the central spot image Ic. It is appreciated that when 
more than two focusing members are integrated into the multiple-element lens 12, more than two 
fields of images are obtained on the focal plane array 12. Further, referring to Figure 4, the 
platform 40 has an octagonal shape, and the mirrors 44 are mounted along every other side of the 
octagon, such that the edge components Les are directed along four orthogonal directions about 
the central component Les. It will be appreciated that according to specific requirement, the 
eonfiguration of the platform, the number of mirrors 43 and 44, the arrangement of the mirrors 
43 and 44 can be altered without exceeding the spirit and scope of the present invention. 
[0030] Alignment of the multiple-beam generator 34 is accomplished through retro- 
reflections using an autocollimator. A beam generated by the autocollimator, preferably a laser 
beam is shone through the collimator and propagates through each of the channels of the 
multiple-beam generator 34. The optical path for the retro-reflection alignment of the multiple- 
beam generator 34 is illustrated as Figure 6. As shown in Figure 6, a mirror 60 is disposed at the 
place where the camera to be aligned will be located. The mirror 60 has a field of view smaller 



than bu. Coser ,o that of the camera. The beams reflected by the mirror 60 are then aligned wrth 
each oflter by the autocoflimator. In the present invention, perfect alignment (as far as anguiar 
precision) for the mmtipte-beam generator 34 is no. demanded. Tolerances are probably greater 
than . degree on the precision of .he alignment This number is dependen, on the system and the 
instantaneous field of view (IFOV) distortion a, the degree of the field. This procedure can be 

expanded .0 a single element alignment procedure where a highly distorted wide field op,,c . 

aligned .0 a focal plane array, in which case .he alignment of the multiple-beam generator 34 ,s 

critical to within 1/10 oflFOV of the camera. 

,003!, With the alignment structure as disclosed above, one car, use me central and 
peripheral spot images Ic and ,p ,0 afign the multiple-element lens 12 of the camera system. 
Figure 7 shows the flow chart of me afignmen, a.gori«hm. Referring .0 Figures 1, 2 and 7, 
step 700, a coarsely focusing step is performed on the central and peripheral spot images .U and 
,p The coarse focusing step 700 is performed by translating the mulnple-elemen. lens 10 a ong 
'direction until the central and peripheral spot images Ic and ,p are as wel, focused on the foca, 
piane array 10 as possible. The focusing condition is preferably observed by the operator; or 
Lnative.y, the focusing can be implemented by electronics which measures the energy 
detected by a pre-se.ected region and surrounding region of .he pre-selected regton. The 
energies detected by the surrounding region relative ,„ tha, of the pre-se.ected region are then 
minimizedbyshiftingmemultiple-elementlenslOalongz-dtrectton. 
To,,,, After the coarsely focusing step 700, in step 702, the muUiple-e.ement lens 
1 J, a,„ng Oz-duection (about the z-axis) .0 minimize the distance between the centra, s o, 
Zs c of two fields, .deafly, the central spot images ,c are overlapped with each other m step 
7 twler, as each focusing member .OA and 10B is manufactured with certain leve of 

704 , , e piemen, lens ,0 is — ^ * ^ 

When the manufacturing defect is compensated in step 704, a retining s p 

le lile of central spo, images ,c between these two fields ,s performed by ro.a,mg the 

mul ,ip,e.e,emen, lens along Oz-axU ^ . ^ ^ ^ 

rnimi When the central spot images Ic ot tnese xwo nc 

Zgh steps 700 to 706, in steps 70S and 7,0, me mu.fiple-e.emen. tens ,0 ,s rotated a,o„ g x 
Z Virions for mimmizmg the distances of me corresponding periphera, spo, tmages ,p 
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between these two fields. In the embodiment as shown in Figure 5, two peripheral spot tmages 
,„ and the eentral spot image le in each field are captured along x-axis on the focal plane array 
,0 while two peripheral spot images Ip and the centra, spot image Ic in each field extend along 
v-axis on the focal plane array 10. Therefore, in step 708, the multiple-element tens 10 is roared 
ateng Ox-direction to minimize the distance of the peripheral spot images lp along x-drrectton 
between mo fields along the x-direc.ion, and in step 710, te multiple-element lens 10 is rotated 
along Oy-direction until the corresponding peripheral spot images lp along y-direction between 



two fields overlap. 

,00341 In step 710, the resultant distance of each pair of corresponding spot images between 
two fields is measured. If the distance is out of the tolerable range, the process flows back to 
step 706 and steps 706 to 710 are repeated until the distance is within the tolerable range. In «h,s 
embodiment, Ore tolerable range is about ,/10 pixel. Therefore, when the distance between each 
pair of corresponding spot images in two fields is larger than 1/10 pixel, steps 706 to 7,0 for 
ahgning fire centra, and peripheral spot images Ic and Ip are repeated until the distance , - no 
,argcr man 1/10 pixel of the camera system. When these two fields are we,, afigned wtm eac 
other the focus condition for each of the central and peripheral spot images Ic and Ip rs observed 
in step 712 If Are focusing condition falls within a tolerable range, for example, »hen the 
energies of the spot images Ic and ,p captured by the pre-setected region of me foca, plane array 
exceeds a predetermined percentage of that of the centm, and edge component Lcs and Us, the 
alignment is complete in 7,6. On the contrary, when me energies of the spot unages Ic and 
caiured by the pre-se,ected region of Ore foca, p,ane array rs ,ower than the pre— 
plntage a focus step 7,4 is performed by —ting the multiple-elemen, lens ,0 along z- 
aT Steps 7,0 to 7,4 are repeated un.il .he distances and the focusing condition fal, wrthm .he 

STX— exemplary embodiments of afignmen, structure and 

I glnt algorithm of a muldple-elemen, lens camera system. The scope of fids d,sc,osure , 
Hired by these exemplary embodiments. Numerous variations, whether exphefly provded 
" 2 speCficadon or imphed by the specification, such as variations in shape, — 
Ho, type of materia, or manufacturing process may be implemented by one of s,U m the 
art in view of this disclosure. 
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